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We present our recent work on stochastic particle systems on complex networks. As a noninter- 
acting system we first consider the diffusive motion of a random walker on heterogeneous complex 
networks. We find that the random walker is attracted toward nodes with larger degree and that 
the random walk motion is asymmetric. The asymmetry can be quantified with the random walk 
centrality, the matrix formulation of which is presented. As an interacting system, we consider 
the zero-range process on complex networks. We find that a structural heterogeneity can lead to 
a condensation phenomenon. These studies show that structural heterogeneity plays an important 
role in understanding the properties of dynamical systems. 
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I. INTRODUCTION 

During the last several years, complex networks have 
been attracting a lot of interest in the statistical physics 
community [E S H, 0|- Complex networks are charac- 
terized by a heterogeneous structure, which is accounted 
for by a broad degree distribution. The degree distribu- 
tion Pd e g(k) denotes the fraction of nodes with degree fc, 
where the degree of a node means the number of links 
attached to it. In contrast to periodic regular lattices, 
many real-world complex networks exhibit fat-tailed de- 
gree distributions. Particularly, some networks displays 
the power-law degree distribution Pd eg (k) ~ fc -7 with 
the degree exponent 7. Such networks are called scale- 
free (SF) network. Examples include the Internet, the 
World Wide Web, scientific collaboration networks, and 
so on. 

Recent studies have revealed that the heterogeneous 
structure of complex networks has a nontrivial effect on 
physical problems defined upon them. In the percolation 
problem, for instance, the percolation threshold vanishes 
as the second moment of the degree (fc 2 ) diverges 
Hence, a SF network with 7 < 3 has a percolating cluster 
at any finite node/edge density. Similarly, the onsets of 
phase transitions in (non-) equilibrium systems strongly 
depend on the heterogeneity through (fc 2 ) [f| 0]. The 
scaling behavior of dynamical systems is also influenced 
by the structures of underlying complex networks [1, 

In this paper we present a brief review of recent works 
on stochastic particle systems on complex networks [TTI . 
EH [l3| . This is to understand how the structural hetero- 
geneity influences the dynamical and the stationary-state 
properties of particle systems [3, [IH, [H, [13] • We address 
this issue in the context of the random walk process and 
the zero-range process, which will be presented in Sec. [TTI 
and Sec. IIII1 respectively. 



This paper is organized as follows. In Sec. QTJ we con- 
sider a random walk on general networks. We are particu- 
larly interested in the stationary-state probability distri- 
bution for the random walker position and the mean first 
passage time (MFPT). The random walk study shows 
that a diffusing particle tends to be attracted toward 
nodes with large degree. It also shows that the diffusive 
motion on complex networks is asymmetric in that the 
MFPT from one node to another is different from that in 
the reverse direction. The asymmetry can be quantified 
by the so-called random-walk centrality. We present a 
matrix formulation for the quantity. The random-walk 
study hints that condensation will occur in interacting 
many-particle systems on complex networks. In Sec. Mil 
we consider the zero-range process on complex networks. 
We will show that the structural heterogeneity of under- 
lying networks leads to condensation in which a macro- 
scopic finite fraction of total particles is concentrated on 
larger degree nodes. We also present a criterion for the 
condensation. We summarize the paper in Sec. IIVI 

II. RANDOM WALK 

We introduce our notations. The total numbers of 
nodes and edges in a network are denoted by N and 
L, respectively. The connectivity of a network is rep- 
resented with the adjacency matrix A whose matrix ele- 
ments dij = 1, . . . , N) take the values of 1 (0) if there 
is an (no) edge between two nodes i and j. The adjacency 
matrix is assumed to be symmetric (o<j = that is, 
we only consider undirected networks. The degree of a 
node i is denoted by hi, which is given by fcj = J2j a ij- 

At each time step, a random walker performs a jump 
from a node to one of its neighboring nodes selected ran- 
domly. Let us denote the probability to find the walker 
at each node i at the nth time step by Pi(n). The time 
evolution for the probability distribution is given by 
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P(n + l)=WP(n), (1) 
where P(n) = (pi(n), . . . ,PN(n)) is a column vector and 
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W is the transition matrix with matrix element Wij = 
ciij/kj. (The superscript * denote the transpose.) With 
an initial condition P(0), the probability distribution at 
arbitrary time step is given by P(n) = W n P(0). In 
particular, the transition probability of the walker from 
a node j to i in n steps is given by Pij(n) = (W™)^ [l8j |. 

In Ref. [ll| , we showed that the stationary-state prob- 
ability is given by P(oo) = (pi(oo), . . . ,pjv(oo))' with 



Pi(oo) = h/(2L). 



(2) 



Actually, one can check easily that P(oo) is the right 
eigenvector of W with the eigenvalue 1 . The correspond- 
ing left eigenvector is the row vector 1 = (1,...,1). The 
result states that the frequency with which the walker 
visits a node is directly proportional to its degree. There- 
fore, in a heterogeneous network, the walker is attracted 
toward larger degree nodes, which suggests that conden- 
sation or jamming can occur in many-particle systems, 
which will be discussed in next section. 

The dynamical aspect of the random walk is studied 
with the MFPT. We showed in Ref. [TO] that the MFPT 
Tij from a node j to i is given by 



T - 2L 

hi 



R 



(0) 



R 



(0) 



(1 - Sij) + ^—5 i:j , 



where Sij is the Kronecker delta symbol and 



^ = ^{ ftj (n)- ft H} 



(3) 



(4) 



Moreover, we found that the MFPT satisfies the relation 



T ■■ — T- 



1/Ci - 1/Cj , 



(5) 



where Ci is the random walk centrality (RWC) defined 
as 



a 



kj 



2LR, 



(o) ' 



(6) 



The result shows that the random walk speed to a node 
is determined by the RWC: The larger the RWC a node 
has, the faster the random walk motion to it is. 

For the MFPT and the RWC, one needs to evaluate 
the matrix Pj°) with the clement R^ defined in Eq. (J4|. 
We present the matrix formulation for it. First, we define 
a matrix V = P(oo)l by using the product of the column 
vector P(oo) and the row vector 1, which are the right 
and the left eigenvectors of W, respectively, with the 
eigenvalue 1 . It is easy to check that the matrix element 
is given by Vij — pj(oo). Hence, one can write that = 
E~o(W"-V) y . or 
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FIG. 1: Model network with N = 4 nodes and L = 4 edges. 



V™ = V for n > and WV = VW = V. Combining 
these, one can find easily that W" — V is equal to (W — 
V)™ for n > and (I — V) for n — 0. Consequently, the 
matrix R/°) is given by 



R(°) = [I - (W- V)]" 1 - V 



(8) 



The MFPT and the RWC are then calculated from 
Eqs. ([3]) and ((U, respectively. 

We demonstrate the way one calculates the MFPT and 
RWC by using the matrix Pj°) with the simple example 
network shown in Fig. [T] For this network, the random 
walk transition matrix is given by 



W 



1/3 

1 1/2 1/2 
1/3 1/2 
1/3 1/2 



(9) 



The matrix V is given by P(oo)(l, 1, 1, 1) 
with the stationary-state probability P(oo) = 
(1/8,3/8,1/4,1/4)*. Thus, using Eq. ©, one ob- 
tains the matrix PJ - 1 : 



/ 57/64 1/64 -15/64 -15/64 

3/64 27/64 -21/64 -21/64 

-15/32 -7/32 59/96 -5/96 

V -15/32 -7/32 -5/96 59/96 



(10) 



With the matrix, one can easily obtain the MFPT by 
using Eq. ([3|). The resulting MFPT's are given by 



(Tij) 



8 7 9 9 
18/3 2 2 
13/3 10/3 4 8/3 
13/3 10/3 8/3 4 



(11) 



This shows that ^ Tji, the asymmetry of the random 
walk motion. Using Eq. ([6]), we find that the RWC is 
given by C x = 8/57, C 2 = 8/9, and C 3 = C* 4 = 24/59. In 
this example, node 2 has the largest RWC, so one can say 
that node 2 is the most important node in the diffusion 
process. 



r(o) =^T(w n - V) 



(7) 



III. ZERO-RANGE PROCESS 



Note that the matrix V is the projection of W onto the 
subspace with the eigenvalue 1 , which yields the relations 



The study in the previous section shows that the struc- 
tural heterogeneity of underlying networks leads to the 
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non-uniform particle distribution, which suggests that 
the interaction may play an important role in many- 
particle systems in heterogeneous networks. We study 
the effect of the heterogeneity on the property of in- 
teracting particle systems by using the zero-range pro- 
cess (ZRP). The ZRP is a driven diffusive particle sys- 
tem and has been studied extensively on regular lat- 
tices [19|, |2fJ, |2l|. We extend those studies to the het- 
erogeneous network. 

The ZRP is defined as follows: Consider an undirected 
network of A nodes and L edges with the degree distri- 
bution Pdeg{k). There are M particles on the network 
with the density p — M/N. We denote the number of 
particles at each node i as rm = 1, 2, — Those particles 
move around the network according to the dynamic rule: 
At each node i, one particle jumps out of it at a given 
rate qi(mi) and then moves to one of the neighboring 
nodes selected randomly. 

Interestingly, the stationary-state probability distribu- 
tion is known exactly for the ZRP [2l[. It is given in 
factorized form as 



1 N 

P(mi,...,mjv) = jYifiim) 



where Z is a normalization factor and 

' pi(oo) 
qi(m') 



Mm) = n 



(12) 



(13) 



for m > and fi(m = 0) = 1. Here, pi(oo) is the 
stationary-state probability for a single-particle random- 
walk problem on the network. According to the result 
in the previous section, we have Pi(oo) = ki/(2L). Using 
the probability distribution in Eq. (|12[) , one can calculate 
the mean value of the particle number at each node. It 
is given by 



d 

(mi) = z— InFi(z) 
az 



(14) 



where F(z) = J2m=o zm fi( m )- The fugacity variable z 
is limited to the interval z < z c , where z c is given by the 
radius of convergence of the series and should be deter- 
mined from the self-consistency equation M = 

The particle interaction can be incorporated into the 
system through the jumping rate function (m) . In order 
to stress the effect of the structural heterogeneity, we 
concentrate on the simplest case with a constant jumping 
rate function qi(m) = 1. This is a special case of the 
model studied in Refs. [12] and [l3[. For this case, the 
function F { (z) is given by F t (z) = J2m= ( zk i) m = V( 1_ 
zki) [22j, and the mean occupation number is given by 



{mi) 



1 — zki 



(15) 



The fugacity is limited within the interval z < z c = 
where kyi is the maximum degree, and its value 



should be determined from the self-consistency equation 
zk, _ zkP^W 
k 



1 ^ — zki \ — ^ zkT 
A t-r 1 1 — zki 



zk 



(16) 



Note that the occupation number is a monotonically 
increasing function of the degree. Hence, nodes with the 
maximum degree kja have the largest occupation num- 
ber, which could be divergent (macroscopically large) 
in the z — > z c = \jku limit. This suggests a possi- 
bility that heterogeneity-induced condensation may take 
place. Condensation refers to a phenomenon in which 
some nodes are occupied by macroscopically many num- 
bers of particles. 

The occupation number distribution depends strongly 
on the degree distribution Pdegik). We demonstrate 
the condition for heterogeneity-induced condensation in 
the following: (i) Suppose that the degree distribution 
Pdeg{k) is supported on a finite interval k < kia, where 
the maximum degree &m is finite. The general feature 
of this case can be understood easily with an explicit 
example described by 



Pdeg(k) = adk,k! + bS k ,k 2 



(17) 



where a+b = 1 and k± < lt2 — kj^r < oo. Periodic lattices 
have a degree distribution of this form. For finite a and 
6, it is easy to verify that the self-consistency equation 
p = azki/(l — zki) + hzkij{}- — zk?) has the solution 
z with finite e = l/fca — z for all values of p. Since e is 
finite, the mean occupation number at each node is cither 
zk\j(\ — zki) or zk^/il — zk-i) and finite, so the system 
does not display condensation. 

The situation changes drastically when a heterogeneity 
is introduced in the degree distribution. Let us assume 
that there is an impurity node having a higher degree 
than the other nodes. Such networks can be described 
by a degree distribution of the type as in Eq. (JTTJ) with 
b = 1/N. The nodes with degree k\ and k^ will be called 
the normal and the impurity nodes, respectively. The 
self-consistency equation becomes 



p= ( 1 - — 

N 



zki 



1 zk 2 



1 - zki A 1 - zk 2 



(18) 



Since z < z c = l/fc 2 , the mean occupation num- 
ber at the normal nodes is bounded above by p c = 
zki/ (1 — zk{)\ z=z — kij(k,2 — ki), which implies that 
the whole fraction of particles cannot be accommodated 
into the normal nodes when p > p c . Consequently, in 
the large- A limit, one finds that the occupation num- 
ber is given by m nor . = p c for normal nodes and by 
mi m p. = N(p — p c ) for the impurity node. That is to 
say, the system displays condensation when the particle 
density exceeds the threshold value. 

These considerations using the model degree distri- 
bution given in Eq. (fTT]) can be easily extended to the 
general case: If Pd eg (k) is supported on a finite inter- 
val k < kM and Pdeg{k = &m) is finite, condensation 
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does not occur at any value of p. On the other hand, 
if there are a few nodes with a higher degree than the 
other nodes (Pd eg {k = ku) — 0(1/N)), heterogeneity- 
induced condensation can take place. It occurs when 
the particle density exceeds a threshold value p c — 
Efe<fc M kP deg {k)/{k M ~ k). 

(ii) We now consider a degree distribution, which is 
supported on the unbounded interval of k in the limit of 
N — > oo. The SF networks with the power-law degree 
distribution P c i eg {k) ~ fc -7 and the Erdos-Renyi ran- 
dom networks with the Poisson distribution Pd eg {k) = 

e ~ {k) ^kT belong to this class. The ZRP's in the SF net- 
works and the random networks are studied in Refs. fl2j 
and [23(. For finite N, those networks still have a finite 
maximum degree ku = ku(N), which will diverge as 
N — > oo. For example, ku ~ iV 1 ^ 7-1 ) and ku ~ InJV 
for the SF networks and the random networks, respec- 
tively. 

One can write the self-consistency equation in the form 
of p = p n + p s where p n = J2k<k M zkP deg(k)/(l - zk) 
is the fraction of particles in nodes with k < ku and 
p s = zkuPdegiku) / '(1 — zku) is the fraction of particles 
at nodes with k = ku- In the large- N limit, one can make 
an approximation p n ~ f M dk zkPd eg (k)/(l — zk). The 
integral interval can be divided into two parts, k -C ku 
and k ~ ku- The first term makes an Oiz) contribution 
while the second term can make a singular contribution 
as z — > z c = 1/ku- Thus, for z — z c — e with small e, the 
quantity p n can be approximated as 

/kht 
dkz/(l - zk) + 0(l/k M ) 

* k M Pde g {k M ) |ln(l - zk M )\ + 0(l/k M ) 
~ k M Pdeg(k M ) |lnefeM| + C(l/fc A f). 

Since A: a/ — * oo in the N — » oo limit, we can neglect 
the second term coming from the integral in the interval 
k -C fcjw- For networks with finite mean degree, the de- 
gree distribution should decay faster than Pd e g(k) ~ A: -2 . 
This insures that the first term also vanishes in the 
ku — * oo limit for any finite value of e. This analysis 



shows that the whole fraction of particles in the nodes 
with k < km vanishes in the N — ► oo limit, which im- 
plies that the whole fraction of particles should be con- 
densed into the node with the maximum degree k = ku- 
Therefore, we conclude that heterogeneity-induced con- 
densation always occur at any value of p on networks with 
a degree distribution supported on the infinite interval. 



IV. SUMMARY 

We have considered stochastic particle systems on com- 
plex networks and studied the effect of the structural 
heterogeneity in networks on the properties of the parti- 
cle systems. In the random-walk model, we showed that 
the heterogeneity makes the random walk motion biased 
and asymmetric: The random walker visits higher degree 
nodes more frequently, and the diffusion to higher ran- 
dom walk centrality nodes is faster than it is to lower ran- 
dom walk centrality nodes. We have presented the matrix 
formalism for the mean first passage time and the random 
walk centrality. In the ZRP with a constant jumping rate, 
we showed that the structural heterogeneity can give rise 
to condensation. For networks with a finite maximum 
degree in the N — > oo limit, the condensation occurs 
only when there are a few impurity nodes with higher 
degree and the particle density is greater than a thresh- 
old value. In that case, the impurity nodes are occupied 
by a macroscopically large number of particles, and the 
other nodes by a finite number of particles. For networks 
with a diverging maximum degree in the N — > oo limit, 
condensation always occurs at any finite value of the par- 
ticle density. In this case, the whole fraction of particles 
is condensed onto the node with maximum degree. 
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